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Preface 


These notes are considered as the part that should follow to the previous 
book with the title Analysis |: infinitesimal calculus. They are an introduction 
to the methods of functional analysis used to solve problems about 
differential and integral equations. Functional analysis is seen as linear algebra 
for infinite dimensional spaces. Especially it is the study of certain linear 
spaces, the function spaces and their use in the solution of the Cauchy 
problem associated to those equations. 


The search for existence and unicity of a solution for boundary problems, and 
all the problems turning around it, both applied and theoretical, are quite old 
and taught in all the universities worldwide. These problems should be solved 
as they occur in many practical issues, in engineering, physics, economics, 
biology... 


So to get to these important studies, mathematicians begin first by simple 
things as finite dimensional linear spaces, and as usual when they enter in the 
infinite case, they discover many dramatic changes. 


To move from simple calculus toward all this complicated machinery, students 
need three essential tools in undergraduate curriculum: 


—Infinitesimal calculus (i.e. differential and integral calculus). 
—Linear algebra. 


—General topology(point set topology). 


My aim is especially to give the reader the logic of the transition from the 
calculus to functional analysis and the difficult points he may met through this 
itinerary, so the chart of my notes to reach this aim will be as follows: 
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Chapter 1: 


In this first chapter we begin with the theory of linear spaces studied in Linear 
Algebra and its ideas. This theory with its linear aspects is very important in 
many branches of mathematics for its simplicity compared to nonlinear 
aspects. For instance linear spaces are the spaces with which we will work all 
the time. Even if the space is not metric, its linearity will help us a lot. Here 
we see only finite dimensional spaces beginning by the very natural space R”. 
We will review vectors, vector spaces, linear dependence, basis ... 


Chapter 2 


We study norms and their generalization to metrics, the idea is that we want 
to generalize the length of a vector, like the length of a segment in the three 
known spaces R?, IR”, IR? , to the general space IR”. We first begin by taking a 
short look at general neighborhoods studied in general topology, then we 
move to metrics then to norms. Norms as special cases of metrics, are the 
very natural to work with, and of course the first natural norms in R” are 
presented. Later we learn that the norms in infinite dimensional function 
spaces are very tricky. 


Chapter 3: 


To linear spaces are linked the very important linear applications between 
linear spaces, and we see many new concepts linked to them like: kernel, 
image,... a linear map has many good proprieties, like continuity, that we will 
use all the time. 


Chapter 4 


When the dimension of our linear space is finite, then every linear map can be 
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presented with a matrix. Also a matrix is seen as another facet of a linear 
function. Here we encounter eigenvalues and eigenfunction of matrices, the 
conjugate of a matrix , symmetric and Hermirian matrices, .... Linear functions 
and their associated matrices are special cases of linear operators. 
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Chapter 1 


Linear spaces 


Linearity is a useful and appropriate propriety in many occasions here, and 
when we work ona problem involving a space of objects (numbers, 
functions,...)we wish that our environment ,i.e. the space in question, is linear 
because the things are much more simpler. As an example of how linearity is 
very natural in everyday life, suppose you buy 2 kilograms of apples, knowing 
the price of 1kg, you only have to double the price, following the law (the 
linear map) for this 


f(x +x) = f(x) + FX) 


or simply 


f (2x) = 2x 
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g(x) = x? 
So if you square this function in x + x or 2x you will get 


x? + 2x +1 


The worse is that the residue term x? + 1 alone is much bigger 
yee Sx 


try now the two laws : log(x) and e~. 


Vectors: 


The natural origin of vectors is the plane IR? and also the physical space R?. In 
the general space IR”, a vector v is determined by its components or 
coordinates, so in R* and R*, we can write either 


ay 
v= & or V = (4, a2, a3) 


where Qj, ...,@, are the coordinates of the vector v. By this there is no 
objection when we generalize vectors by coordinates to IR”, so we likewise 


write 
ay 
v= or v = (Qj, ..,An) 
Qn 
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The vector v can be seen as a point in the space IR”. There is no difference 
between the two above notations. The only difference rises when we want to 
make a product of two vectors or a product of a vector and a matrix. 


Orthogonality will be needed in the subsequent chapters, so we say that two 
vectors are orthogonal( or perpendicular) if their dot product (or scalar 
product) equals to zero 


Vv, O° v2 =0 


And this presented in terms of each vectors components by the known 
product 


by 


(Qienttp)oO| x =) a xb. = 0 


Linear space 


A space in mathematics is a non-empty set with a structure defined in it for 
certain purpose. Geometers worked in terms of linear spaces(or vector 
spaces) since Antiquity; but these spaces began to see their systemization as 
an achieved theory only since the beginning of the XX century. Very 
important spaces that we will need in subsequent treatment are naturally 
linear spaces: Lebesgue spaces L?((), the space of test functions D(Q), the 
space of distribution D’(Q) ... without linearity our work would be impossible. 


Definition 


Let IKK a set of numbers A; , that is a commutative field IK and E a set of 
vectors that verify two sets of axioms: 


mohammedfulano@ hotmail.com University of Constantine 
10 


So in a linear space we have : 


i) a vector addition " + " between the vectors. 


ii) a scalar multiplication "." between the vectors and the numbers(scalars) of 
the field K. 


In almost the cases K_ is either R or C. We say that (EF, +) is a linear space 
over the field (IK, +,.). Any field (IK, +) is a vector space over itself (IK, +,.). 


The above axioms were written down for the first time by Polish Stephan 
Banach(1892-1945) in 1932 and shortly after by Norbert Wiener(1894-1964). 
We can read: 


Fréchet was very excited by the fact that Banach had given a system of axioms for 
vector spaces months before Wiener". 


Examples: 


1) The excellent linear space over itselfis R. 


2) The plane IR? the set of vectors of geometry, makes itself a linear space. 


* Oeuvres de Banach , prefaced by his friend H. Steinhaus(p.15). See Geometry by its history (p.262). 
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3) IR? a very special set of vectors used in physics and geometry, it is a linear 
space, and the appellation vector comes from this space. 


4) in fact all R” when n > 3 is finite are linear spaces. So IR” is seen as the 
set of all n-tuples 


(Vinge) 


5) The set of sequences u := {u,,} noted £? where 1 < p < +o, such that 


+00 
> lend? 
n=1 


converges is a linear space. In particular 2® is the linear space of bounded 
sequences. 


6) The set of sequences {u,,} converging to 0, noted cy and the set of 
sequences {u,,} that are null for a certain n > k noted Cog are both linear 
spaces. 


Remarks 


— One should make a difference between the number 0 € K and the vector 
O0€ E?2. 


Linear subspace 


Inside any linear space E we may find another linear space, this new space is 
called a linear subspace, we can consider E as a subspace of itself. 


Some authors write the vector 0 as 0. 
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Definition 


Let E a linear space and F is subset of E. We say that F is a linear subspace of 
E if: 


i) For every v1,v2 € F wehave: v, + v2 EF. 
ii) For every v € F and every a € K wehave: a.veEF. 


A subspace of a linear space cannot be empty, it contains at least the unit 
vector 0 for the operation " + ". So in any linear space we can find at least two 
linear subspaces. 


Examples: 
1) a line passing by (0,0) is a subspace of the plane R?. 
2) the line R is a subspace of the plane R? which is itself is a subspace of R?. 


3) The set of continuous functions over [0,1] noted by the notation C°([0,1]) 
is a linear subspace of Lebesgue linear space L”([0,1]) which itself is a 
linear subspace of the more general linear space of arbitrary functions 
F([0,1]) so we may write 


c°((0,1)) < LP([0,1]) ¢ F(0,1)) 


Basis 


Before explaining what a basis of a linear space is, we first define the 
following: 


Definition 


We say that n vectors in a linear space E 
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are linearly independent if the zero equation 


O10 At 0.0 


implies that all the coefficients a; = 0. 


This is extremely essential in linear algebra, linearly independent means that 
we cannot express any vector in terms of the other vectors (independence). 
From the equation 


ZV, — 5V>2 = 0 


we infer that v, and v, are linearly dependent as we can write the vector v7; 
in term of the other vz (and verse versa) 


Vy = = V2 


Now let 


a set of n linearly independent vectors in E 


Definition 
We say that (ej, ..., €,) is a basis for the linear space E if every vector v in E 
can be written as a linear combination of the vectors (€,,...,€n) 
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Vey te, 


We say that (@,,...,€,) Spans the linear space , or that (e,,...,€,) isa 
span for E. 


We have the convention 


span (0) = {0} —,  span(@) = {0} 


Definition: 
Soaset of vectors (€,...,€,) constitute a basis for a linear space E iff: 
*) (€1,.-,€,) spans E. 


*) (€1,.-,€,) is linearly independent. 


a basis help us to write these vectors as the alphabet letters help us to write 
words. The idea of a basis comes from the vector space IR” where any point 
p € R” has the form 


V= Aye, Fo FT Anen 


where a; are real numbers. 


Remarks 


—The basis of a given linear space is not unique, but for any vector v written 
in a given basis, the numbers qj,...,@, are in IK and are unique. 
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— To show that a set of n vectors (€;,...,€,) isa basis for R”, it suffices to 
show that the determinant 


|(€1, --,€n)| # 0 
Examples: 


For the real spaces IR??? we can use the following basis 


i) for R_ the basis 


(0,1) 


ii) for IR? 


{(0,1), (1,0)} 


iii) for R? 


{(1,0,0), (0,1,0), (0,0,1)} 


For the general R” 


{(1,0, ...,0), (0,1, ...,0), ..., (0,0, ...,1)} 


The previous chosen basis are called canonical or standard as they are the 
usually natural used basis for these spaces 


Theorem 
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Every linear space has a basis. 


We can prove this result and many others by using the axiom of choice. This 
axiom was first stated by German mathematician Zermelo(1871-1953) in 
1904, and although it is extremely important, there was time when it was very 
controversial because it implies the existence of a certain function of choice f 
of which mathematicians were not unanimous. Now the game is over, the 
axiom is accepted by all mathematicians and used everywhere in Analysis 
because of the following: 


*) It is quite natural, and in fact, it has been used by many mathematicians 
from the XIX century before Zermelo without realizing it. 


*) It is necessary for the proof of important coming results in this course like 
the Hahn-Banach theorem... 


*) Since its introduction and use, no one has found a contradiction to it. 


*) Logicians results have given credence to it, beginning by Gédel result(1938) 
that the axiom of choice is consistent, in a sense that it cannot be a 
contradiction in set theory, then by Cohen(1963) that the axiom of choice is 
independent, meaning it is not a theorem for it either’. 


*) It is equivalent to many basic assertions in other domains of mathematics 
as: Hausdaurf maximum principle, well-ordering principle and Zorn lemma. 
On Zorn lemma, H. Brezis says: 


"Zorn's lemma follows from the axiom of choice, ...[it] has many important 
applications in analysis. It is a basis tool in proving some seemingly innocent 
existence statements such as "every vector space has a basis" and "on any vector 
space there are nontrivial linear functional". Most analysts do not know how to prove 
Zorn's lemma; but it is quite essential for an analyst to understand the statement of 


° The interested reader in the history of this axiom can look in the book of G.H. Moore. 
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Zorn's lemma and to be able to use it properly!" 


Dimension of a linear space 


The idea of the dimension of a vector space E comes from the usual R”. It is 
linked to: 


i) the concept of linear independence . 
ii) the number of linearly independent vectors in E. 


In fact, the dimension of a linear space is expressed as the maximum” number 
of vectors that its basis contains. 


Definition 


let E be a linear space, the dimension of E is the maximum number of 
independent vectors in E. If this number is n we write 


dim(F) =n 


So we have for any linear space E with a basis (€1,...,€n) : 


i) We cannot write any vector from the space E in less than n linearly 
independent vectors. 


ii) If we write a vector v in a linear space of dimension nin n+ 1 vectors, 
these n + 1 vectors must be linearly dependent. 


“In his book : Functional analysis p. 2. 
° So if there are no maximum bound for the number of vectors the dimension is infinite. 
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Examples: 
1) The line R for example has dimension 1 because any vector has one 
component 


v= a,e, 


Where any e, # 0 is linearly independent because if a,;e, = 0 then a, = 0. 


2) The plane IR? has dimension 2 because any vector has two components and 


Vv = aye; + Aze2 


where (e,, €2) are two chosen linearly independent vectors. 


Theorem 


let E be a linear space, and V a subspace of EF 


dim(E) > dim(V) 


So 


dim(IR?) > dim(R?) > dim(R) 


Defining the dimension of a linear space, then the linear spaces with which we 
deal can be of two categories: 
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—Finite dimension spaces: which are excellently presented by the original R” 
, the dimension n is the maximum number of linearly independent vectors. 


—Infinite dimensional spaces: mathematicians at the end of the XIX century 
,have discovered that when dealing with differential equations, one can 
consider linear spaces with an infinite basis, and these new spaces proved to 
be very tricky. These are examples of linear spaces with infinite dimension, 
they are spaces of functions that verify certain conditions: 


i) C[a, b] : space of continuous functions over the interval [a, b]. 
ii) L’[a, b] Lebesgue spaces of functions defined over [a, b]. 


iii) W”™ [a, b] : Sobolev spaces of functions defined over [a, b]. 


1) Show that two vectors in the plane R? are dependent iff they are parallel. 
1) show that 0 is a vector space, it is a subspace of any linear space. 

1) Show that a linear subspace cannot not empty and contain at least the unit 
element 0. 

1) Show that the vector 0 is dependent. 

1) Show that a set of vectors containing O are dependent. 

1) What are the components of 0? 

1) Show that a set of vectors which contains a linearly dependent subset are 
linearly dependent. 

1) are the following linear subspace of R? 

i) the interval |0, +00]. 

ii) the interval [0, +00]. 

iii) the interval [0,1]. 

1) show that {0} is a subspace. 

1) show that the vector 0 belongs to any subspace. 

1) is the line given by the equation y = x + 1 a linear subspace of R?? 
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1) Show that the components of a vector in a given basis are unique. 
1) what is the minimum numbers of linearly independent vectors in the linear 
spaces R, IR? and R?? 

1) give examples of each sequence of the following sets: 
i) e+ 

ii) 7 

iii) Co 

iV) Coo 

1) show that: Cp) C P? COQ CL”. 

1) is the following vectors in R forma basis 

i) ((1,0)) 

li) ((2,3)) 

iii) ((0,0)) 

1) is the following vectors in R? forma basis 

i) (1,0), (1,0)) 

ii) ((1,0), (1,3)) 

iii) ((1,2), (—1,1)) 

1) is the following vectors in R? forma basis 

i) ((1,0), (1, -1) (1,1) ) 

ii) ((—1,0), (1,0), (2, -2)) 

iii) ((1,1), (2,1), (—1,1)) 
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Chapter 2 


Norms 


When we deal with real numbers in the real line IR to make a comparison 
between any two numbers we take their distance to each other. We can 
present the distance between two numbers a and b by a positive number 
given by the absolute value 


la—b| = |b—a|=0 


and this positive number is in fact the distance from O, so the difference 
between the numbers can be moved to the origin O specified by the number 
0. 


ja—bl=c 
7) c 
$f 
a el b ‘“ 
c 
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In many situations that we met treating Cauchy problem, we have to compare 
between two objects in our linear spaces: two vectors, two matrices, two 
functions ...as we compare between lengths, then mathematicians had to find 
tools that permit them to do such operations, and this perfect tool is the 
concept of norm , the generalization of usual length in R*”°. 


Topology 


This is just a short review of general topology , and we insist that topology is 
all about continuity. 


Definition 
Let T a set containing subsets of FE that verifies: 


i) E and @ €t. 
Wt) Uj. APE t. 
iii) Nt A; € Tt. 


We say that T is a topology over E, a topology is defined by neighborhoods 
called "open sets"( as open intervals are neighborhood for the real numbers). 
A general neighborhood is a very abstract form of the usual distance that we 
know, it translates the expression "a is near to b" without reference to any 
proper distance ,length,... so to get richer neighborhoods we move to the 
more concrete metrics. 


Metric 


A metric defined in a set, is stronger than a topology: 


Definition 


We say that d is a metric over a set E if: 
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i) dy) = 0, 
li) d(x,y) =O x=y. 

iii) d(x, y) = d(x, y). 

iv) d(x,z) <= d(v, y) + dG,z). 


To express a distance on a set , the two following proprieties are sufficient® 


e)d(x,y)=0S4 x= y. 


*) d(x,z) < d(x, y) + d(y,z). 


But in common references of Functional Analysis we find two more( i) and iii 
). The propriety (i) is easy to prove, for the propriety (iii) we can prove it like 
this : we start from 


y 


d(y,z) < d(x,y) + d(x,z). 
If x =z then 


d(y,z) < d(z,y) 
then if we start with 


d(z,x) < d(x,y) + d(y,z). 


and putting x = y then 
d(z,y) < d(y,z) 


° See Banach ( p. 8) referring to A. Lindenbaum. In fact Lindenbaum (1904-1941) said in his paper:" 
There are still two propositions: p(x, y) = 0 and p(x,y) = p(y,x), which we see separately 
postulated elsewhere, this because the triangular inequality is almost always expressed in a less 
suitable form... ". 
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The result followsm. 


Every set E with a metric defined on it is a metric space , and is noted (E, d) 
Je) 


metric spaces © topological spaces 


Any metric induces a topology, this means there is a topology or a system of 
neighborhoods associated to the metric as a metric is a special case of a 
topology. 


Examples: 


1) We return to the metric 


d(x,y) =|x—-y| 


defined on the real line IR . The conditions of a metric are fulfilled: the first is 
by definition positive |x — y| => 0, and we have also |x — y| = Oiff x=y. 
For the third we have 


lx — yl = |-1ly — xl = ly — x| 


For the triangular inequality we have 


Ix-zl=|(x-y)+(v-2lslx-ylt+ly—2l 


2) The second example is very special: it is the natural distance in the plane 
R?, it is measured by the famous Pythagoras theorem. Let x(a,,b,) and 
y(az, bz) two points(vectors) in IR*, then we define 
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d(x,y) = ¥ (az — a,)? + (bd, — by)? 


When we generalize to the IR” is 


d,(x,y) = 


‘ Sc — bi)? = (Sa = nr) 


It is the canonical or usual metric in IR". The reader may have noticed that the 
first example is just a special case of this, for we have 


d(x,y) = 


> Gq = bo? == (@= bY = la = b| = bx 


3) We now give freedom to our imagination and consider a distance called the 
discrete metric, its defined as 


(hk Nf ee y 
ate) ={ 9 if 227 


We see immediately that ) , ii) and iii) are verified. We look to prove the 
triangular inequality 


d(x,z) < d(x,y) + d(y,z) 


— if d(x, z) = 1 (meaning that x # z) then d(x, y) and d(y,z) cannot be 
both 0, because that leads to a the contradiction x = z. 


mohammedfulano@ hotmail.com University of Constantine 
26 


— if d(x,z) = 0, then whatever the value at the right is, the inequality is true 
a. 


For this bizarre discrete metric, all the elements in E are equidistance. 


Norms 


Every norm is a special metric, norms are the special metrics that we will work 
with all the time. 


The first axiom is the definiteness of the norm and it is usually written 


lx] =Oex=0 


the opposite implication is provable. The second axiom is homogeneity of the 
norm. The third is of course is the known triangular inequality. 


Every set E withanorm ||__ || defined on it is a normed space, noted 
(E, || |) and we have 


normed spaces © metric spaces 


So every norm is a metric and every metric is a topology, both metrics and 
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norms define abstracts distances. Like metrics, for any norm there is a 
topology (a system of neighborhoods) associated to it 


System of neighborhoods 


Metrics 


Fig. Unifying the three notions. 


Anorm || _ || defines a stronger topology and helps us to define and work with 
the notion of convergence. It is hard usually to find the right norm (especially 
if the space is infinite dimensional), we will discover that it belongs to the 
genius of a mathematician when working on a new space of functions to 
choose the right norm in order that the space is complete... 


As we have defined the norm we can calculate the distance between two 
vectors(or objects) by using the metric 


Definition: 


The distance between two objects(vectors,...) x and y is 


d(x,y) = Ilx — yll 
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We can also treat convergence by the norm, so a sequence of maps f, 
converge to a certain function f in terms of the norm 


If — fall — 0 


and as 


d(x,0) = ||x — Ol] = Ilxll 


norms are "weights" of objects and the distance is like the difference of those 
weights. Particularly the norm of x is the distance of x from the object O( the 
point 0, the vector 0, the function 0....) 


Examples: 


1) We return the usual metric 


lll] = [x] 


i) []O|] = |O| = O , and for ii) ||x]| = |Ax| = |A||x] . iii) We simply use the 
triangular inequality in the plane. The distance between x = —5 and y = 5on 
the real line R is 


d(x, y) = [15 — (—S)Il = Il-5 — 5]| = 10 


2) Comparatively to the already seen metrics we can define the corresponding 
general standard norms 
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1/p 


n 
I lp =) lal 
i=1 


and the usual Euclidian for p = 1,2. 


3) We can also borrow the supremum norm form the uniform convergence of 
functions to numbers, so we define the norm 


Iull.o = max{|up |} 


on the set of sequences, and sup becomes max as the u,, are defined 
numbers’. 


Equivalence of norms 


With all the previous norms there is a question that asks itself: these norms all 
work, so are there some differences between them? 


So we say that two norms |lu||, and ||u||, are equivalent if there exist two 
positive numbers a@ and f such that 


Bllulle < llull, S allull. 


as 


Theorem 


In finite dimension spaces, all norms || || are equivalent. 


7 4 function may not reach its max so we should put sup in place of max. 
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This result is false in infinite dimensional spaces. 

Semi-Norms 

In many occasions we met metrics such that the first propriety of a norm 
cannot be verified, namely: 


|x|] =O>x=0. 


So in this case we are in face of a semi-norm. 


Example: 


As an example of a semi-norm we consider points z = (x,y) inthe plane R? 
and we define the norm 


lIzll = IG yl = lx — yl 


we see that |x — y| = 0 whenever x = y. 


As avery known example in Analysis, we can cite Lebesgue integrable function 
space £() (not L(Q) ), which constitutes a semi-normed space. We will 
see also with the spaces L?(Q) the concept of quasi-norms. 
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Remark 


— Using the unifying language of mathematics, a metrics is seen as application 
a from the linear space E to the positive real numbers 


d(a,b): EXER" 


Likewise for the norms and semi-norms 


lal: E> R” 


Famous inequalities 


As J. Dieudonné says : 


"Infinitesimal Calculus is the learning of the manipulation of inequalities much more 
than equalities". 


In Functional Analysis, mathematicians have to compare between his objects 
of study like: vectors, matrices, functions, ...So after we have found the 
"weight" which is the concept of norm, so we now need also to know the 
"tools" (the scales) to implement this weight, these tools are the inequalities . 
What is very important about inequalities is that they are everywhere in 
mathematics not only in Analysis, and in this broad domain we find many 
interesting relations®. The big challenge that remains for the reader is : when 
and how to use an inequality. 


English mathematician Hardy(1877-1947) et al. have written a whole book on inequalities in more 
than 300 pages. The seminal proof of the Poincaré conjecture, due to Gregory Perelman, extensively 
uses Harnack inequality. 
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Minkowski inequality 


Due to German Hermann Minkowski(1864-1909). For real numbers a;, b; we 
have 


1/p 


n 1/p n 1/p n 
(Sie se Hr) < (Sa) + (Sine 
i=1 i=1 i=1 


Minkowski inequality uses only one number p and it implies an addition. A 
special case is the triangular equality, it is the case when p = n= 1 


la+ b| < ja] + |b| 


Also in spaces of functions we can write it 


1/p 1/p 1/p 


b b b 
| Fo tgPax) < | Fooled | + i Igor dx 


Holder inequality 


Due to German Otto Hdlder (1859-1937). Unlike Minkowski inequality, this is 
associated with two numbers (p, q) which are conjugated, namely they verify 


So we have the Holder inequality 


mohammedfulano@ hotmail.com University of Constantine 
33 


1 1 
n n Dp n q 
> la-bil < (Sa) , (Sit 
i=1 i=1 i=1 


notice that it is a product. Special case of this inequality is the very known 
Cauchy-Schwartz inequality that holds when p = q = 2: 


= 
2 


n n n 3 
> la. bil < (> iat (Si) 
i=1 i=1 i=1 


This special equality is also called Bouniakowsky inequality, to Ukrainian 
Viktor Bouniakowsky(1804-1889) who discovered it in 1859. 


We also have the integral version for functions f integrable on [a, b] 


1/q 


b b 3 D 
[ircog@lax <|{ fifirar} . { figirax 


Both Minkowski and Hélder inequalities are called convexity inequalities. 


Young inequality 


Due to English mathematician W. Young(1863-1842), with conjugated (p, q) 
as uSual 


And for every a,b = 0 we have 
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1)is {R,@,all Ja, b[} a topology over R? 
1) show that any metric verifies d(x, y) = 0. 
1) say if the following are metrics: 

i) 


_fl if x=y 
a(x.) = {9 if xy 


1) show that any metric given by a norm should verify: 
t) d(ax,ay) = |a|d(x,y). 
ii)d(x+a,y+a)=d(x,y). 

1) show that any norm verify the axioms of a metric. 
1) let || || be a norm, show that : x = 0 => ||x|| = 0. 
1) is the discrete metric a norm? 

1) prove the following inequalities : 

i) lly — xl = Ix + Ibyvll 

i) lll — Ilyll = Ix — vil 

1) Say if the following are only semi-norms on R?: 

i) I wll = Ix + yI 


i) Ix, yl = I] 
i) I Il = layl,a@ eR. 
1) write the expression of the standard norm || ||, forp = 1 and p = 2. 


1) show that Minkowski inequality is true for p = 1. 
1) show that 


d(x,y) = ¥ (a, — by)? + (az — bp)? 
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is a metric in R?. 
1) Show that 


d(x,y) = 


is a metric in R”. 
1) show that the following is a norm 


Ixll2 = ¥ (a1)? + (az)? 
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Chapter ia 


Maps between linear spaces 


We now introduce maps between two linear spaces, and many concepts 
associated to them. The first thing to know is that : if f is a linear map from E 
to F ,then both E and F must be linear spaces. 


Linear map 


A linear map’ from E to F transforms a vector from E to another vector in F 
, the name linear map is an appellation to any /inear application , linear 
function or a linear transformation . 


°We say also: mapping, application, function. 
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We can simply compose the two conditions V x,y € E as 


flax + By) = af (x) + BF) 


when the scalars a,B arein KK as R or C. 


Examples: 


1) Any linear map from R to R has the form” 


f(x) =ax 


where is a a real number. 


2) The map from R? to R 


f (5) = @ +29) 


3) The map from R_ to R? 


poo = (2) 


*° In some references aimed at engineering and applied mathematics, and with a non-rigorous fashion 
that makes particularly purists cry, one can find expressions like :" y = ax + bisa linear function", 
meaning an equation for a line. 
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4) The map from R? to R? 


Remark 


*) linear maps are a special case of morphisms (or homomorphisms ) between 
groups (as (E,+) and (F,+) are groups) that are defined as 


f:(G,@) — (G2,0) 
f(V%1 @ v2) = f(v)OF (V2) 


*) A linear map is very desirable map which has many special proprieties like: 


fO)=0 


A law that follows from a propriety of any morphism of groups 


fle) =e, 


*) When f is a morphism from E in itself, it is called an endomorphism. When 
the morphism f is bijective, it is called an isomorphism. If f is an isomorphism 
from E to itself, then f is called an automorphism. 


The two examples 1) and 4) are endomorphisms. 


Kernel and images 


mohammedfulano@ hotmail.com University of Constantine 
39 


To a linear maps between two linear spaces E and F is associated two 
subspaces: the null subspace (or kernel) and the image subspace. 


We can prove this propriety about the kernel: 


Theorem: 


if Kerf = {0} if and only if then f is injective . 


i) Kerf = {0} => f is injective. 


We say that f is injective when 


fO)=fC2) = M=% 


Suppose that Kerf = {0}only, thenif f(x,) = f(x2) then f(x, — x2) =0 
(as f is linear) which gives automatically x; = x2 as 0 is the only value that 
makes f vanishes, so f is injective m. 
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When the dimension of the spaces E is finite these two subspaces has 
interesting proprieties 


Theorem: 
let f: E — F alinear map and E isa linear space of finite dimension then 


dim(E) = dim(Ker) + dim(Im) 


Examples: 


1) consider the endomorphism 
x 
fG)=@y 


The kernel (x, 0) is a whole line and its dimension is 1, the image (0,y) isa 
whole line and its dimension is 1, and we have 


dim(E) = dim(Ker) + dimUm) =1+1=2 


Dual space 
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ii) The topological dual of FE: the set of continuous maps defined on E£, it is 
noted E’. 


The theory of the duals of linear spaces was developed in the beginning of the 
XX century, and it has been used for example by Laurent Schwartz (1915- 
2002) to build his theory of distributions. 


Continuity of linear maps 


If the set E is a finite dimensional linear space we have 


feEr* = fee’ 


That means: 


Theorem 


In a finite dimension space E, all linear maps are continuous. 


In a space with an infinite dimension, this may be not true; there are maps 
defined on an infinite dimensional space, although linear, but are not 
continuous, as we will see in the theory of linear operators. 


mohammedfulano@ hotmail.com University of Constantine 
42 


1) say if the following maps are linear: 
i) from R* to R 


) FG) =@-y+D. 
) FG) =@-») 


*) f (5) = (2x = v3y) 
ii) from R to R? 

1 _ 
)fo=(5”) 


_ (logy) 
*) fy) = coo) 


m™—y 
*) ro =( 1 


y 
iii) From R? to R? 
ytG)=C Ges) 
»tG)=Cre”) 


o1G)= ("23") 


log(2) 


1) Show that if f is a linear map from E to F both E and F must be linear 
spaces. Is the converse true? 

1) let f bea linear bijective map, show that f~? is linear. 

1) Show that f(0) = 0. 

1) Show that a morphism of groups f verifies: f(e,) = ep. 

1) Give a nonlinear morphisms from (IR**,x) to (R, +). 

1) Give a nonlinear morphisms from (R, +) to (IR,x). 

1) are the functions In(x) and e~ isomorphisms? 

1) Show that if f is a linear injective then Kerf = {0}. 

1) is the following map 
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an isomorphism? an automorphism? 


1) is the map 


f (5) =O») 


injective? why? 
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Chapter 4 


Linear maps as matrices 


Linear maps and matrices are very linked to each other, the set of linear maps 
is a linear space and the set of matrices is also a linear space over R and C. 
Moreover we will discover here that any linear map between two linear 
spaces can be presented as a matrix, which is not necessary squared. 


Matrix 


The theory of matrices has been introduced by Cayley(1821-1895), the word 
matrix’* was coined by his friend Sylvester(1814-1897) , one of the purpose 
of this theory also was to facilitate the writing of linear transformations(or 
linear systems) 


* A Latin word meaning womb. 
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Or simply 


Ax =b 


where aj,; are the coefficients, the x = (Xj,...,X,) are the unknowns and 
b = (by, ...,bn) the second member. So to study a big cumbersome linear 
system of equations, one has only to study the matrix A. 


Remark 


The existence of solutions for any linear system Ax = b depends on the 
determinant of the squared matrix A: 


*) if det(A) #0, we have a unique solution. 
**) if det(A) = 0, we have two cases : 
—either there are no solutions at all. 


—or there are infinitely many solutions. 


Some algebra of matrices 


There is a lot to say about this subject, but we keep ourselves to the 
minimum: 


—A matrix can have one of the three used notations 
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(ai;) [aij| | aij | 


—A matrix with n rows and m columns may be written as n X m matrix. Any 
vector either orthogonal or horizontal 


ay 


An 


is seen as a matrix of the form n X11 or 1 Xn. A matrix A whose entries all 
are zeros is called the nu// or zero matrix. 


—lf the matrix A is squared, we call it simply matrix of order n. Any matrix of 
order n then, unlike arbitrary matrices, has a diagonal composed of the 
diagonal numbers noted a;;. 


—The transpose of a matrix A noted A’ is the matrix obtained when we 
invert the rows and column, so (a;;) become (a;i). The transpose of the 


vector(matrix) 
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ay 


A= 


we have the propriety 
(AB) = BTAT 


—Any matrix of order n, possess a determinant noted det(A) which may be 
equal to 0, we have 


det(AB) = det(A) det(B) 


— If det(A) = 0, we say that A is singular, in this case A has no inverse. 


—A product of two matrix A and B can be the null matrix without one of the 
two matrices is, as a general example for the 2 X 2 case 


a b —b -b\_ (0 O 
LC 4 ‘ ( a a ) 7 (5 a 
notice that both determinants are zero, Kline wrote” 


" Cayley asserted that the product of two matrices may be zero without either being 
zero, if either one is singular. Actually, Cayley was wrong; both matrices must be 
singular. For if AB = 0, A #0, B #0, and only A is singular, then the inverse of B, 
namely B~1, exits, and ABB~1 = 0B~1 = 0. But BB+ = I. Therefore Al = 0 or 


* In Kline text | have put singular in place of indeterminate. See Kline p.807. 
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A=0". 


Matrices and linear maps: 


An important result that illustrate the relation between matrix and linear 
maps 


Theorem 


To every matrix of n rows and p columns we can associate a linear map f, and 
vice versa. 


A linear map transforms a vector to another vector, a matrix A ina linear 
system Ax = b does the same work and with its coefficients transform a 
vector to another vector. 


So the similarity 


fo=W) ~ A(v) = (w) 


If the linear map f is from R™ to IR” then the matrix has the form n x m 
(n rows and m columns) and vice versa. 


Examples: 


i) The matrix has 2 rows and 2 columns 


mohammedfulano@ hotmail.com University of Constantine 
49 


so it is associated to a linear map from R? to R? 


(O=G DO=Gey) 


its associated matrix is G 


(+= G 1)G) 


iii) the following matrix has 3 row and 1 columns 


its associated linear map is from R to R? as 


1 x 
709 =( s)oo =( sx) 
-—3 —3x 


Remark 
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*) To a given linear map f: E — F the associated matrix changes according to 
the basis in E. 


Eigenvalues of a squared” matrix 


As a matrix transforms a vector to another vector we can write the general 
form of this transformation as Av = w , among all these vectors there are 
special vectors associated to each matrix A of order n verifying 


Av =Av 


the reader observes in this case that A does not change the direction of the 
vector v, only its scaling or its sense, so the number A is the eigenvalue” of 
A andv its eigenvector. 


There is a method to find these eigenvalues: 


The polynomial P,(A) is called the characteristic polynomial of A and its roots 
, the eigenvalues, are named the specterum of A. 


Example: 


i Keep in mind that a non-squared matrix has no determinant. 
** Form the German word Eigen (own) so the meaning is : own-value, typical-value. 
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Let A the following matrix 


So we form 


det(A — AI) = det ((; ) = (5 °)) 


=|5-¢_,|=#-24-8 


So the roots of the characteristic polynomial A? — 2A — 8 constitute the 
spectrum 


spec(A) = {-2 ,4} 


Remark 


*) As a linear map f and its associated matrix A are 
morphisms(endomorphism,...) we usually say : find the eigenvalues of the 
endomorphism... 


*) The eigenvalues of an endomorphism... as solutions of a polynomial 
equation, can be either real or complex. 


We have the following interesting result 


Theorem 


Let A be a squared matrix and let A; be its eigenvalues, then 


mohammedfulano@ hotmail.com University of Constantine 
52 


wi A; = Tr(A) } TA; = det(A). 


The trace of a squared matrix A is the sum of its diagonal numbers a;; 
n 


Tr(A) = > Aj 


i=1 


In the preceding example 


n 
> 4 =-24+4=2=141=7r(A) 
1 


and 


[ [a= Cam =-8= 1-9 =aer(a) 


Another result linking matrix to its eigenvalues 


Theorem 


Any matrix A of order n verifies its characteristic polynomial which is also of 
degree n. So 
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The result is known as Cayley-Hamilton theorem , attributed to Cayley(1858) 
who proved it in the special case n = 3 and to Irish W. Hamilton (1805-1865) 
who proved it for linear transformations(1853), the general result for matrices 
has been proved by German Frobinius(1849-1917) in 1878. 


Symmetric matrix 


One important matrix that will be considered much is the symmetric matrix. 


Definition 
We say that A is a symmetric matrix if: 


Al =A 


We can simplify this by writing it by the matrix coefficients : for all i, 7 : 


Aig = Aji 


an example of asymmetric matrix is 


An interesting case of a symmetric matrix is when the coefficients aj; are in C 
: we Say that a matrix is Hermitian if 


AT =A 


where: a+.ib =a — ib, an example is 
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The matrix AT has also the name self-adjoint of A. The reader can easily 
prove that every real symmetric matrix is Hermitian. 


French mathematician C. Hermite(1822-1901) proved an interesting propriety 
for such matrices in 1855. 


Theorem 


If A is Hermitian then its eigenvalues are real. 


1) Show that : det(A7A) > 0. 


-1)\ _ 1 
1) Show that (A ar 
L «2 


4 3 


. What do you infer? 


1) Find ( ) ~1 by two methods. 


12 
1) Find the determinant of the matrix F 2 
20 


bE Rw 


| by three methods. 


1) Show that A“? if it exists is unique. 

1) Show that: (AB)~? = B-1A™? 

1) discuss the existence of solutions for the linear system : Ax = 0. 

1) show that if 2 is an eigenvalue for A, then A~? is an eigenvalue for A~?. 
1) if A2 = A the A is an idempotent matrix (idem : same potent). Show that 
det(A) = Oor 1. 
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1) Show that all idempotent matrices are singular except /. 

1) Let A idempotent, show that J] —A is idempotent. What about A — /? 
1) if A~* = A’ , Ais orthogonal € O,(IR). Show that det(A) = +1. 

1) in: A = P“*BP, A and B are similar . Show that det(A) = det(B). 

1) give the matrix associated to each linear map: 


i) 
+) = (33) 
ii) 
x — —_ 
a(v)=(xty”) 
Z 
iii) 


1) give the linear maps associated to each matrix: 


t) 
0 
1 
= 
1 
ii) 
cay, 
0 1 
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iii) 


(1, 2, —1) 


1) Show that: A+ A? is symmetric. 

1) let A any matrix, show that AA’ is squared. Show then that AA? is always 
symmetric. 

1) Show that if A is symmetric then A~? (if it exists) is also symmetric. 

1) Show that any real symmetric matrix is Hermitian. 
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